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Objections to the Drawings 

1 . The drawings are objected to under 37 CFR 1 .83(a). The drawings must show 
every feature of the invention specified in the claims. Therefore, the following 
features must be shown or the feature(s) canceled from the claim(s). In Claim 3 
"evaluating uncertainties," and "combining said optical flow measurements, said 
intensities, and said uncertainties." In claim 4, "applying an error function," "applying 
an optical flow constraint," "deriving a motion estimate," and "comparing said motion 
estimate." In claim 6 "deriving flow covariance matrices," "deriving intensity 
covariance matrices," "applying relevance criteria," and "performing detection." In 
claim 10 "applying an optical flow constraint," "applying an error function" "deriving 
amotion estimate," "comparing said motion estimate," "deriving covariance matrices," 
"performing optimized detection," evaluating uncertainties," and "combining said 
optical flow measurements, said intensities, and said uncertainties". In claim 11 "a 
joint 5-dimensional space comprising 3 color components and 2 flow components." 
No new matter should be entered. 

2. Corrected drawing sheets in compliance with 37 CFR 1 .121(d) are required in 
reply to the Office action to avoid abandonment of the application. Any amended 
replacement drawing sheet should include all of the figures appearing on the 
immediate prior version of the sheet, even if only one figure is being amended. The 
figure or figure number of an amended drawing should not be labeled as "amended." 
If a drawing figure is to be canceled, the appropriate figure must be removed from 
the replacement sheet, and where necessary, the remaining figures must be 
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renumbered and appropriate changes made to the brief description of the several 
views of the drawings for consistency. Additional replacement sheets may be 
necessary to show the renumbering of the remaining figures. Each drawing sheet 
submitted after the filing date of an application must be labeled in the top margin as 
either "Replacement Sheet" or "New Sheet" pursuant to 37 CFR 1 .121(d). If the 
changes are not accepted by the examiner, the applicant will be notified and 
informed of any required corrective action in the next Office action. The objection to 
the drawings will not be held in abeyance. 

Rejections Under 35 U.S.C. 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claim 3-10 are rejected under 35 U.S.C. 103(a) as being unpatentable over Lee 
US PGPUB 2003/0058237 in view of Simoncelli, Eero, "Bayesian Multi-Scale differential 
Optical flow" Handbook of Computer Vision and Applications, Academic Press, Vol. 2 
pp. 397-422. 

3. Re claims 3-6 Lee discloses a method for dynamic scene modeling and change 
detection applicable to motion analysis, comprising the steps of: making 
measurements of optical flow (see paragraph 69 line 8) and intensities (paragraph 
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20 lines 6-7 RGB information is intensities) for said dynamic scene(see paragraph 6 
line 1 1 if objects are moving the scene is dynamic); utilizing said optical flow 
measurements for capturing (i.e. detecting paragraph 69 line 7) and modeling 
(model maintenance paragraph 69 line 4 ) the dynamics of said scene (paragraph 
71 lines 5-8 this section describes modeling movement which is the dynamics of the 
scene); evaluating uncertainties in said measurements (see paragraph 39 a 
covariance is a measure of uncertainty); and combining said optical flow 
measurements (see paragraph 69 lines 3-9 the model is maintained based on 
optical flow), said intensities (see paragraph 39 the pixels modeled in the RGB color 
space (i.e. using intensities)), and said uncertainties (of intensity) (see paragraph the 
pixels are also modeled via covariance (i.e. uncertainty)) so as to develop a robust 
(see paragraph 69 this model can handle movement and therefore is robust) 
representation ( model see paragraph 69 line 2) of said scene (background 
paragraph 69 line 2) in a higher dimensional space (see paragraph 69 line 4 The 
background has multiple layers and therefore is higher dimensional). Lee does not 
disclose derive a figure of uncertainty (covariance is a figure of uncertainty page 410 
1rst paragraph) for optical flow measurement data. However, Simoncelli discloses 
deriving a figure of uncertainty (covariance is a figure of uncertainty page 410 1rst 
paragraph) for optical flow measurement data. The motivation to combine is to take 
advantage of using a "efficient" gradient approach while allowing for more then 
"small displacements" when calculating optical flow, see page 398 paragraph 2. 
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Therefor it would have been obvious to one of ordinary skill in the art to modify the 
invention of Lee with Simoncelli to reach the aforementioned advantage. 

4. Re claim 4 Simoncelli further discloses wherein said step of evaluating 
uncertainties in said measurements comprises the steps of: applying an optical flow 
constraint equation (equation 14.1 page 398) at a given point defined by a spatial 
location and time (page 398 last paragraph) to obtain respective constraints; 
applying an error function (page 399 second paragraph) to combine said respective 
constraints from each said given point (page 398 second paragraph) within a defined 
region for deriving a characteristic function(equation 14.3 page 399) ; deriving a 
motion estimate(velocity estimate 4 th paragraph page 399) from said characteristic 
function; and comparing said motion estimate with a given uncertainty model 
(covariance information page 410 1rst paragraph) so as to derive a figure of 
uncertainty (indicate more uncertain vectors page 410 1rst paragraph) for optical 
flow measurement data. 

5. Re claim 5, Simoncelli further discloses wherein said figure of uncertainty (page 
400 4 th paragraph) exhibits a Gaussian characteristic (page 401 paragraph 2). 

6. Re claim 6 Lee discloses a method for dynamic scene modeling and change 
detection applicable to motion analysis, comprising the steps of: deriving optical flow 
measurement data for said dynamic scene (Paragraph 69 line 9); deriving intensity 
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(RGB information) data for said dynamic scene (paragraph 20 lines 5-8); deriving 
intensity covariance matrices for said intensity data (paragraph 39 line 3); applying 
relevance criteria (training see paragraph 57 line 1) to said intensity covariance 
matrices (paragraph 57 line 5 note the parameters of the model included covariance 
matrices) for selecting relevant features (parameters paragraph 57 line 4) of a 
subset thereof; and combining said relevant features (into a trained model paragraph 
57 line 5 ) of said subset for performing detection (background foreground 
segmentation paragraph 52). Lee does not disclose, Deriving flow covariance 
matrices for said optical flow measurement data; applying relevance criteria to said 
flow covariance matrices for selecting relevant features of a subset thereof and 
combining said relevant features of said subset for performing detection. However 
Simoncelli discloses deriving flow covariance matrices for said optical flow 
measurement data (paragraph 3 page 401); applying relevance criteria (uncertainty 
of vectors page 41 0 first paragraph) to said flow covariance matrices for selecting 
relevant features (uncertainty of vectors page 410 first paragraph) of a subset 
thereof and combining said relevant features of said subset for performing detection 
(these features are used for optical flow which is used in detection of background 
layers of Lee paragraph 69). The motivation to combine is to take advantage of 
using a "efficient" gradient approach while allowing for more then "small 
displacements" when calculating optical flow, see page 398 paragraph 2. Therefor it 
would have been obvious to one of ordinary skill in the art to modify the invention of 
Lee with Simoncelli to reach the aforementioned advantage. 
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7. Re claim 8 Lee further discloses wherein said step of combining said relevant 
features comprises detection at a particular pixel (note the segmentation is 
preformed on each pixel paragraph 52 line 2). 

8. Re claim 9 Simoncelli further discloses wherein said step of deriving optical flow 
measurement data comprises applying the Simoncelli algorithm (see title and 
author.) 

9. Re claim 10 Simoncelli further discloses, wherein said step of deriving optical 
flow measurement data comprises the steps of: applying an optical flow constraint 
equation (equation 14.1 page 398) at a given point defined by a spatial location and 
time (page 398 last paragraph) to obtain respective constraints; applying an error 
function (page 399 second paragraph) to combine said respective constraints from 
each said given point (page 398 second paragraph) within a defined region for 
deriving a characteristic function(equation 14.3 page 399) ; deriving a motion 
estimate(velocity estimate 4 th paragraph page 399) from said characteristic function; 
and comparing said motion estimate with a given uncertainty model (covariance 
information page 410 1rst paragraph) so as to derive a figure of uncertainty 
(covariance is a figure of uncertainty page 410 1rst paragraph) for optical flow 
measurement data; deriving flow covariance matrices for said optical flow 
measurement data (paragraph 3 page 401); evaluating uncertainties in optical flow 
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measurements (indicates uncertain vectors page 410 paragraph 1.) While lee further 
discloses, deriving intensity covariance matrices for said intensity measurement data 
(see paragraph 39); evaluating uncertainties in said intensity measurements (see 
paragraph 39 a covariance is a measure of uncertainty.) combining said optical flow 
measurements (see paragraph 69 lines 3-9 the model is maintained based on 
optical flow), said intensities (see paragraph 39 the pixels modeled in the RGB color 
space (i.e. using intensities)), and said uncertainties (of intensity) (see paragraph the 
pixels are also modeled via covariance (i.e. uncertainty)) so as to develop a robust 
(see paragraph 69 this model can handle movement and therefore is robust) 
representation ( model see paragraph 69 line 2) of said scene (background 
paragraph 69 line 2) in a higher dimensional space (see paragraph 69 line 4 The 
background has multiple layers and therefore is higher dimensional). 

10. Claim 7 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Simoncelli and Lee as applied to claim 6 above, and further in view of "Statistical 
modeling and performance characterization of a real-time dual camera surveillance 
system" Greiffenhagen, M.; Ramesh, V.; Comaniciu, D.; Niemann, H.; Computer 
Vision and Pattern Recognition, 2000. Proceedings. IEEE Conference on Volume 2, 
13-15 June 2000 Page(s):335 - 342. 

11. Re claim 7, Lee and Simoncelli discloses all of the features of claim 6. They do 
not disclose wherein said step of deriving intensity covariance matrices comprises a 
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step of deriving covariance matrices of normalized color representation. However 
Greiffenhagen discloses wherein said step of deriving intensity covariance matrices 
comprises a step of deriving covariance matrices (in page 3 column 1 first paragraph 
2 line 15) of normalized color representation (illumination invariant in page 3 column 
1 first paragraph 2 line 1 5). The motivation to combine found in page 3 column 1 first 
paragraph is to "handle shadowing and illumination changes." Therefore one of 
ordinary skill in the art would find it obvious to combine Griffenhagen with Lee and 
Simoncelli to reach the aforementioned advantage. 



Allowable subject Matter 

12. Allowable subject matter, claims 1-211-13 and 25 are allowed. Claims 1 and 25 
are allowable because the prior art does not include adding said current input to said 
image background model with a low probability whenever said probability is below 
said threshold. Claim 1 1 are allowable because while Lee show discloses a 
probability distribution containing 3 color components and Simoncelli discloses a 
distribution with 2 flow components the are not in a joint 5-dimenstional space. 
Therefore the prior art does not show a probability distribution of said intensity and 
said optical flow in a joint 5-dimensional space comprising 3 color components and 
2 flow components. 
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Conclusion 

1 3. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Sean Motsinger whose telephone number is 571- 
270-1237. The examiner can normally be reached on 9-5 M-F. 

14. If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jingge Wu can be reached on (571 )272-7429. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273- 
8300. 

1 5. Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR 
only. For more information about the PAIR system, see http://pair-direct.uspto.gov. 
Should you have questions on access to the Private PAIR system, contact the 
Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would like 
assistance from a USPTO Customer Service Representative or access to the 




